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Abstract 



Suppose that an automorphism group G acts flag-transitively on a finite gener- 
alized hexagon or octagon S, and suppose that the action on both the point and 
line set is primitive. We show that G is an almost simple group of Lie type, that is, 
the socle of G is a simple Chevalley group. 



1 Introduction 

The classification of all finite flag-transitive generalized polygons is a long-standing impor- 
tant open problem in finite geometry. Generalized polygons, introduced by Tits in [18] . 
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are among the most notable and prominent examples of discrete geometries, they have a 
lot of applications and are the building bricks of the Tits buildings. The determination 
of all finite flag-transitive examples would have a great impact on many problems, not 
in the least because of a significant weakening of the hypotheses of many results. It is 
generally considered as an "NC-hard" problem, where NC stands for "No Classification 
(of finite simple groups allowed)". By a result of Feit and Higman [5J, we must only 
consider generalized triangles (which are the projective planes), generalized quadrangles, 
generalized hexagons and generalized octagons. In each case there are nontrivial examples 
of finite flag transitive geometries, and it is believed that we know all of them. The most 
far reaching results are known for the class of projective planes, where the only counterex- 
amples would have a sharply transitive group on the flags, and the number of points must 
be a prime number, see [D] . For generalized quadrangles, besides the well known classical 
(and dual classical, in the terminology of [14J) cases there are exactly two other exam- 
ples, both arising from transitive hyperovals in Desarguesian projective planes, namely 
of respective order 4 and 16 (and the hyperovals are the regular one and the Lunelli-Sce 
hyperoval, respectively). Both quadrangles have an affine representation, that is, their 
point set can be identified with the point set of a 3-dimensional affine space, and the 
line set is the union of some parallel classes of lines of that space (more precisely, those 
parallel classes of lines that define the corresponding hyperoval in the plane at infinity). 
For generalized hexagons and octagons, only the classical (Moufang) examples are known 
to exist, and the conjecture is that they are the only flag-transitive ones (and some even 
conjecture that they are the only finite ones!). An affine construction similar to the one 
above for quadrangles can never lead to a generalized hexagon or octagon, and this obser- 
vation easily leads to the nonexistence of generalized hexagons and octagons admitting a 
primitive point-transitive group and whose O'Nan-Scott type is HA (see below for precise 
definitions). 

This observation is the starting point of the present paper. Since the classification of 
finite flag-transitive generalized polygons is NC-hard, we have to break the problem down 
to a point where we must start a case-by-case study involving the different classes of finite 
simple groups. One celebrated method is the use of the famous O'Nan-Scott Theorem. 
This theorem distinguishes several classes of primitive permutation groups, one being the 
class HA above. Another class is the class AS, the Almost Simple case, and this class 
contains all known examples of finite flag-transitive generalized hexagons and octagons. 
Ideally, one would like to get rid of all O'Nan-Scott classes except for the class AS. The 
rest of the proof would then consist of going through the list of finite simple groups 
and try to prove that the existing examples are the only possibilities. In the present 
paper, we achieve this goal. We even do a little better and prove that we can restrict to 
Chevalley groups, that is, we rule out the almost simple groups with alternating socle, 
the sporadic groups being eliminated already in [2]. The treatment of the different classes 
of Chevalley groups is a nontrivial but — so it appears — a feasible job, and shall be 
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pursued elsewhere. Note that the classical hexagons and octagons have a flag-transitive 
automorphism group of almost simple type with socle the simple Chevalley groups of 
type G2, 3 D4 and 2 F4. Their construction is with the natural BN-pair. The automorphism 
group of these polygons is primitive on both the point-set and the line-set, and it is also 
flag-transitive. 

We note, however, that our assumptions include primitive actions on both the point 
and the line set of the generalized hexagon or octagon. In some case, this can be weakened, 
and we have stated our intermediate and partial results each time under the weakest 
hypotheses. This could be important for future use when trying to reduce the general 
case to the primitive one handled in large in this paper. 

A similar treatment for the finite generalized quadrangles seem out of reach for the 
moment. Therefore, we restrict ourselves to the cases of hexagons and octagons for the 
rest of the paper. 

2 Setting 

Let S = {V,jC, I) be a finite point-line geometry, where V is a point set, £ is a line set, 
and I is a binary symmetric incidence relation. The incidence graph of S is the graph with 
vertex set V U C, where the adjacency relation is given by the incidence relation I. The 
diameter of S is by definition the diameter of the incidence graph of S, and the gonality 
of S is by definition half of the girth of the incidence graph of S (which is a bipartite 
graph and therefore has even girth). For n ^ 2, the geometry S is a weak generalized 
n-gon, if both the diameter and the gonality of S are equal to n. If every point is incident 
with at least three lines, and every line carries at least three points, then we say that S 
is thick, and we call it a generalized n-gon, or generalized polygon. In this case, there are 
positive integers s, t ^ 2 such that every line is incident with s + 1 points, and every 
point is incident with t + 1 lines. We call (s, t) the order of S. If n = 2, then S is a trivial 
geometry where every point is incident with every line. If n = 3, then S is a projective 
plane. 

A generalized 6-gon (or hexagon) S with order (s,t) has (1 + s)(l + st + s 2 t 2 ) points 
and (1 + t) (1 + st + s 2 t 2 ) lines. The number of flags, that is the number of incident 
point-line pairs, of S is equal to (1 + s)(l + i)(l + st + s 2 t 2 ). Also, it is well known that 
st is a perfect square (see [HI [19]). A generalized 8-gon (or octagon) S with order (s,t) 
has (1 + s)(l + st)(l + s 2 t 2 ) points and (1 + t){\ + st)(l + s 2 t 2 ) lines. The number of 
flags of S is equal to (1 + s)(l + i){l + si){l + s 2 t 2 ). Also, it is well known that 2st is a 
perfect square (see 0(12]). Hence one of s, t is even and consequently, either the number 
of points or the number of lines of S is odd. 

Let S = (V, C, I) be a generalized hexagon or octagon. A collineation or automorphism 
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of G is a permutation of the point set V, together with a permutation of the line set £, 
preserving incidence. The group of automorphisms is denoted by Aut S and is referred to 
as the automorphism group of S. If G is a group of automorphisms of S, then G can be 
viewed as a permutation group on V and also as a permutation group on C. The main 
theorem of this paper is the following. 

Theorem 2.1 Suppose that G is a group of automorphisms of a generalized hexagon or 
octagon S = (V, C, I). If G is primitive on both V and C and G is flag-transitive then G 
must be an almost simple group of Lie type. 

3 Some preliminary results 

The next result will be useful to rule out the existence of generalized polygons with a 
certain number of points. Suppose that n is a natural number and suppose that n = 
3"p^i . . .p^k w h ere the p. are pairwise distinct primes all different from 3, a ^ and 
ati ^ 1 for all %. Then we define the following quantities: 

a{n) = 3 max{0 ' Q " 1} Yl PT\ 

Pi^l mod 3 

b{n) = J] pT- 

Pi^l mod 4 

We obtain the following result about the number of points of a generalized hexagon or 
octagon. 

Lemma 3.1 Suppose that S = (V,£, I) is a generalized hexagon or octagon. 

(i) If S is a generalized hexagon, then a{\P\Y ^ \P\. 

(ii) If S is a generalized octagon, then b{\V\) 2 ^ \V\. 

Proof, (i) Suppose that S is a generalized hexagon with order (s,t). Then \V\ = 
(1 + s)(l + st + s 2 t 2 ). As mentioned in the previous section, st is a square, and it was 
proved in the last paragraph of [2, page 90] that if p is a prime such that p\l + st + s 2 t 2 , 
then p = 1 (mod 3); in addition, 1 + st + s 2 t 2 is not divisible by 9. Thus a(|"P|) must 
divide 1 + s and must be divisible by 1 + st + s 2 t 2 . On the other hand, since 

t > 2, we obtain that (1 + s) 2 < (1 + st + s 2 t 2 ), which implies that a(\V\) 2 < \V\/a(\V\), 
and so part (i) is valid. 
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(ii) Suppose that S is a generalized octagon with order (s,t). Then \V\ = (1 + + 
st)(l + s 2 t 2 ). As mentioned above, 2st is a square, and it was proved in [2, page 99] 
that, if p is a prime such that p| 1 + s 2 t 2 , then p = 1 (mod 4). Thus must divide 

(1 + s)(l + st) and |7- , |/fe(|7- > |) must be divisible by (1 + s 2 t 2 ). On the other hand, since 
s, t ^ 2, it follows that (1 + s)(l + st) < (1 + s 2 t 2 ), and so 6(|P|) < |^|/6(|P|), and 
statement (ii) holds. □ 

We will use the following notation: if x is a point collinear with the point y, that is, x and 
y are incident with a common line, then we write x ~ y. Dually, the notation L ~ M for 
lines L, M means that L and M are concurrent; that is, they share a common point. If 
x and z are non collinear points collinear to a common point y, then, assuming that the 
gonality is at least 5, the point y is unique with this property and we write y = x\az. 

If G is a permutation group acting on a set Q then the image of uj G Q under g G G is 
denoted by cug, while the stabilizer in G of is denoted by G^. The group G is said to 
be semiregular if G w = 1 for all u E Q, and it is said to be regular if it is transitive and 
semiregular. 

Lemma 3.2 If S = (V,C,I) is a generalized hexagon or octagon with order (s,t), then 
the following is true. 

(i) If gcd(s,t) 7^ 1 and g is an automorphism of S, then either g has a fixed point or 
there is a point x G V such that x ~ xg . 

(ii) If gcd(s,t) 7^ 1 and g is an automorphism of S with order 2, then g has either a 
fixed point or a fixed line. In particular, if G is an automorphism group of S with 
even order, then G cannot be semiregular on both V and L. 

(Hi) Let x be a point and let y\ and y2 be two points collinear with x such that y\ is 
not collinear with y^. Suppose there are automorphisms g±, gi mapping x to y±, yi, 
respectively. If g\ and g 2 commute, then y x g 2 = y 2 gi = x. 

(iv) If G is an automorphism group of S which is transitive on V , then Ck ut s(G) is 
intransitive on V . 

(v) If G is an automorphism group of S acting faithfully and flag transitively, then 
\G\^\G X \ 12 for allxeV. 

Proof. Claim (i) is shown in [16J. To show (ii), let g be an automorphism with order 
2 and assume that g has no fixed point. Then, by (i), there is a point x G V, such that 
x ~ xg. Suppose that L is the line that is incident with x and xg. Then the image Lg 
of L is incident with xg and xg 2 = x, and so Lg = L. Thus L must be a fixed line of g. 
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If G is an automorphism group with even order then G contains an automorphism with 
order 2. If G is semiregular on V then g has no fixed point in V. Thus, by the argument 
above, g must have a fixed line, and so G cannot be semiregular on L. Thus (ii) is proved. 
In claim (iii), as x ~ yi, the point y 2 = xg 2 is collinear with y\g 2 — x 9\92- Similarly, 
Hi = xgi is collinear with y 2 gi = xg 2 gi = xg\g 2 . Hence if x 7^ xgig 2 , then the gonality of 
S would be at most 4, which is a contradiction. Let us now show (iv). Set C = C/^ ut s(G) 
and assume that C is transitive on V. Let x and y be vertices of S such that x ~ y. Then 
there is some g G G such that xg = y. On the other hand, as S is thick and its gonality is 
at least 6, we can choose distinct vertices y\ and y 2 such that x ~ y%, x ~ y 2 , y ^ yi, and 
y 7^ y 2 . By assumption, C is transitive, and so there are C\, c 2 G C such that xc\ = y\ 
and xc 2 = y 2 . Then we obtain that y\g = y 2 g = x, which is a contradiction, and so (iv) 
is valid. 

Finally, we verify (v). Suppose first that S is a generalized hexagon with order (s,t), 
let x G V and let G x denote the stabilizer in G of x. Since G is flag-transitive, G x must 
be transitive on the t + 1 lines that are incident with x and, in particular, jG^I ^ t + 1. 
Therefore, using the Orbit-Stabilizer Theorem and the inequality s ^ t 3 (see [7] and [T9l 
Theorem 1.7.2(H)]), 

|G| , w 



|P| = (1 + S)(l + St + ^t 2 ) ^ (1 + ^)(1 + t 4 + t 8 ) ^ (1 + t) L1 < 



J' I 



and the statement for hexagons follows. If S is a generalized octagon with order (s,t), 
then, using the inequality s ^ t 2 (see [8] and [TU 1.7.2(iii)]), we obtain similarly that 

\G\ „ , _ Wl , 



|P| = (l + s)(l + st)(l + s 2 t 2 ) < (l + t 2 )(l + t 3 )(l + t 6 ) < (1+t) 11 ^ 



|Gx| 

and the statement for octagons also follows. □ 



We note that a generalized hexagon or octagon is a self-dual structure, and so the dual 
of a true statement is also true. For instance, taking the dual of statement (iv), we obtain 
the following fact: if G is a line-transitive automorphism group of S, then CAuts(G) is 
intransitive on the lines. In this paper we do not state the dual of a each of the results, 
but we often use the dual statements in our arguments. 

We will also need the following group theoretic lemma. Recall that a group G is said 
to be almost simple if it has a unique minimal normal subgroup T which is non-abelian 
and simple. In this case, T is the socle of G and the group G can be considered as a 
subgroup of the automorphism group of T containing all inner automorphisms. 



Lemma 3.3 (a) Let S be an almost simple group with socle T and let H be a maximal 
subgroup of S such that T £ H . Then N T (H n T) = H n T. 
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(b) Suppose that Ti, . . . ,T k are pairwise isomorphic finite simple groups and, for i = 
2, . . . , k, the map : Ti — > Ti is an isomorphism. Then the subgroup 

D = {(t,a 2 (t),...,a k (t)) {ten} 

is self-normalizing in Ti x • • • x T^. 

Proof, (a) If S and T are as in the lemma, then HnT<H. Hence H ^ N s (HnT). Note 
that S can be considered as a primitive group acting on the right coset space [S : H] with 
point-stabilizer H. Since the socle of such a primitive group is non-regular, we obtain 
that H n T ^ 1. Hence H D T is a proper, non-trivial subgroup of T, which cannot be 
normal in 5. Thus, since if is a maximal subgroup of S, we obtain that Ns{H fl T) = H . 
Hence N T (# fl T) = N s (# f]T) f]T = H f]T. 

(b) Let G = Ti x • • • x T fe and let . . . , t fc ) G N G (D). Then, for all teT u 

(t, a 2 (t), . . . , a^t))^ 1 '-'**) = (t* 1 , a 2 (t)' 2 . . . , a fc (t)' fc ) G D. 

Thus, for all i G {2, ...,&}, we obtain that a^t' 1 ) = Therefore G 

Cy^t). As this is true for all t G Ti, we obtain that tia^ e ^(^i)- ^ s ^ s a 

non-abelian, finite, simple group, this yields that CKi(ti) = Hence (ti, . . . ,tk) G D, and 

so Ng(-D) = D. □ 



4 Hexagons and Octagons with primitive automor- 
phism group 

The structure of a finite primitive permutation group is described by the O'Nan-Scott 
Theorem (see [31 Sections 4.4-4.5] or [H Section 4.8]). In the mathematics literature, one 
can find several versions of this theorem, and in this paper we use the version that can, 
for instance, be found in [lj Section 3]. Thus we distinguish between 8 classes of finite 
primitive groups, namely HA, HS, HC, SD, CD, PA, AS, TW. A description of these 
classes can be found below. 

Recall that in a finite group G, the socle of G is the product of the minimal normal 
subgroups in G and it is denoted by SocG. In fact, SocG is the direct product of the 
minimal normal subgroups of G. As a minimal normal subgroup of G is a direct product 
of pairwise isomorphic finite simple groups, the socle of G is also the direct product of 
finite simple groups. 

Suppose that G\, . . . ,Gk are groups, set G — G\ x - • • x Gk, and, for i G {1, . . . , k}, 
let ifi denote the natural projection map tpi : G — » Gj. A subgroup H of G is said 
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to be subdirect with respect to the given direct decomposition of G if (pi(H) = Gi for 
i — 1, . . . , k. If the Gi are non-abelian finite simple groups then the G; L are precisely 
the minimal normal subgroups of G. In this subgroup H is said to be subdirect 

if it is subdirect with respect to the decomposition of G into the direct product of its 
minimal normal subgroups. If G is a finite group then the holomorph Hoi G is defined as 
the semidirect product G x Aut G. 

The O 'Nan-Scott type of a finite primitive permutation group G can be recognized 
from the structure and the permutation action of Soc G. Let G ^ Sym Vt be a finite 
primitive permutation group, let M be a minimal normal subgroup of G, and let cu G Q. 
Note that M must be transitive on Q. Further, M is a characteristically simple group, and 
so it is isomorphic to the direct product of pairwise non-isomorphic finite simple groups. 
The main characteristics of G and M in each primitive type are as follows. 

HA M is abelian and regular, C G (M) = M and G < Hoi M. 

HS M is non-abelian, simple, and regular; SocG = M x C G (M) = M x M and G 
HolM. 

HC M is non-abelian, non-simple, and regular; SocG = M x C G (M) = M x M and 
G < Hoi M. 

SD M is non-abelian and non-simple; M w is a simple subdirect subgroup of M and 
C G (M) = 1. 

CD M is non-abelian and non-simple; M w is a non-simple subdirect subgroup of M and 
C G (M) = 1. 

PA M is non-abelian and non-simple; is a not a subdirect subgroup of M and 
M w ± 1; C G (M) = 1. 

AS M is non-abelian and simple; C G (M) = 1, and so G is an almost simple group. 

TW M is non-abelian and non-simple; M u = 1; C G (M) = 1. 

We pay special attention to the groups of type AS. In this class, the group G has 
a unique minimal normal subgroup which is non-abelian and simple. Therefore G is 
isomorphic to a subgroup of AutT which contains all inner automorphisms. Such an 
abstract group is referred to as almost simple. The next result shows that under certain 
conditions a primitive automorphism group of a generalized hexagon or octagon must be 
an almost simple group. 
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Theorem 4.1 If G is a point-primitive, line-primitive and flag-transitive group of auto- 
morphisms of a generalized hexagon or octagon, then the type of G must be AS on both 
the points and the lines. In particular, G, as an abstract group, must be almost simple. 

Theorem 14.11 is a consequence of the following lemma. 

Lemma 4.2 If G is a group of automorphisms of a generalized hexagon or octagon S = 
(V, C, I) then the following holds. 

(i) If G is primitive on V then the type of G onV is not HA, HS, HC. Dually, if G is 
primitive on C then the type of G on £ is not HA, HS, or HC. 

(ii) If G is flag-transitive and it is primitive on V then the type of G onV is not PA or 
SD. Dually, if G is flag-transitive and it is primitive on C then the type of G on C 
is not PA or SD. 

(Hi) If G is flag-transitive and it is primitive on both V and C, then the O 'Nan-Scott 
type of G onV and on £ is not SD or TW. 

Proof. Let S and G be as assumed in the theorem. Suppose further that G is primitive 
on V and let M be a fixed minimal normal subgroup of G. In this case, M = T\ x • • • x 
where the Ti are finite simple groups; let T denote the common isomorphism type of the 
T 

- 1 - I- 

(i) As M is transitive on V, Lemma r3.2( iv) implies that < Cq{M) must be intransitive. 
Since Cg(M) is a normal subgroup of G, we obtain that Cg(M) = 1. Hence the O'Nan- 
Scott type of G on V is not HA, HS, HC. The dual argument proves the dual statement. 

(ii) Assume now that G is flag-transitive and it is primitive on V. We claim that the 
O'Nan-Scott type of G on V is not PA or CD. Assume by contradiction that this O'Nan- 
Scott type is PA or CD. In this case V can be identified with the Cartesian product T e 
in such a way that G can be viewed as a subgroup of the wreath product H wr where 
if is a primitive subgroup of Sym T and the projection of G into is transitive. Set 
iV = Socif and let 7 G T. We must have that N e , considered as a subgroup of HwrSi, 
is a subgroup of G, and, in fact, N e = SocG = M. Further, we have the following two 
possibilities. 

PA If the type of G is PA then the type of H is AS and we have that N = T, £ = k 
and Nry is a proper subgroup of N. 

CD If the type of G is CD, then the type of H is SD, N = T s where s ^ 2 and s = kjt 
In this case, iV 7 is a diagonal subgroup in iV which is isomorphic to T. 
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Since H is primitive on T, the normal subgroup N must be transitive on T. If 7 £ T, 
then H y is a maximal subgroup of H. Thus Lemma 13.31 implies that Nn(N^) = iV 7 
(part (a) of the lemma applies in the PA case, and part (b) applies in the CD case). 
Suppose that 7, 5 £ T such that iV 7 = N$. Then there is n £ N such that = 5, and 
(iV 7 ) n = Ns = iV 7 . Hence n normalizes iV 7 , and so n £ iV 7 , and we obtain that 7 = 5. 
Therefore different points of T must have different stabilizers in N. 

Let a be an arbitrary element of T and consider the point x £ V represented by the 
£-tuple (a, a, . . . , a). We claim first that there exists a point y ~ x such that every entry 
of the £-tuple representing y is equal to a, except for one entry. Indeed, let y be any 
point collinear with x. Then, if the claim were not true, we may assume without loss of 
generality that y is represented by ((3±, (3%, . . .), where Pi 7^ a 7^ 02- By the argument in 
the previous paragraph, the stabilizers in iV of a and (3\ are distinct, and so there exists 
g £ N a such that (3[ := /3%g 7^ (3\. Put g — (g, In, Iat, ■ ■ ■ , Iat) factors) and y' = yg. 
Let h £ Nfa be such that a' := ah ^ a (such an /i exists by the argument in the previous 
paragraph). Put h — (In, h, In, In, ■ ■ ■ > Ijv) (^ factors), and put x' = xh. Then x' 7^ x, 
and both y and are fixed under h. Since y ~ x ~ y', we deduce y ~ x' ~ y'. This 
implies (because the gonality of 5 is at least 5) that x, x', y, y' are incident with a common 
line. But all entries, except the second, of x' are equal to a. Thus our claim is proved. 

So we may pick y ~ x with y = (/3, a, a, . . . , a) (£ entries) and (3 7^ a. By the flag- 
transitivity, there exists g £ G x mapping y to a point not collinear with y. There are two 
possibilities. 

(a) We can choose g such that the first entry of yg is equal to a. 

(b) For every such g, the first entry of yg differs from a. 

In case (a), as x = (a, . . . , a) and g £ G x , we may suppose without loss of generality 
that y 1 := yg = (a, /3',a, . . . ,a). Choose h,h' £ iV such that ah = j3, and ah' = (3'. 
Put h = (h, In, ■ ■ ■ , Ijv) and h = (In, h', In, ■ ■ ■ , Iat)- Then h and h commute and 
Lemma f3.2( iii) implies that x = xhh . Hence a — (3 — (3', a contradiction. 

In case (b), we consider an arbitrary such g and put z = yg. Also, consider an arbitrary 
g' £ G x not preserving the first component of V x V x • • • x V. By assumption, yg 1 is 
incident with the line through x and y, and we put z' = yg'. If we now let y and y' in the 
previous paragraph play the role of z and z', respectively, of the present paragraph, then 
we obtain a contradiction again. 

Thus we conclude that the type of G on V is not PA or CD and the dual statement 
can be verified using the dual argument. 

(iii) Suppose that S is a generalized hexagon or octagon and G is a group of automor- 
phisms such that G is flag-transitive and G is primitive on V and £ of type either SD or 
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TW. First we claim that S must be a generalized hexagon and gcd(s, t) = 1. If S is a 
generalized octagon with order (s, t), then either \V\ or \C\ must be odd. However, the 
degree of a primitive group with type SD or TW is the size of a minimal normal subgroup, 
which is even, as it is a power of the size of a non-abelian finite simple group. Therefore 
S must be a hexagon as claimed. Assume now by contradiction that gcd(s, t) ^ 1 and 
consider the subgroup 7\ of the socle M. Since G is either SD or TW on V and also on 
£ we have that 7\ is semiregular on both V and on C. However, as T\ is a non-abelian 
finite simple group, T\ has even order, and this is a contradiction, by Lemma I3.2( ii). 

So we may suppose for the remainder of this proof that S is a generalized hexagon 
with parameters (s, t) such that gcd(s, t) = 1. Note that the number of lines is (t+ 1)(1 + 
st + s 2 t 2 ), and the number of points is (s + l)(l + st + s 2 t 2 ). If G has the same O'Nan-Scott 
type on the set of points and the set of lines, then \V\ = \C\, which implies s = t. Since 
gcd(s,t) = 1, this is impossible, and we may assume without loss of generality that the 
type of G is SD on V and it is TW on C. Hence \V\ = (s + 1)(1 + st + sH 2 ) = |T| fc_1 and 
\C\ = (t + 1)(1 + st + sH 2 ) = \T\ k . Thus \T\ = (t+ l)/(s + 1) and so t = s\T\ + |T| - 1. 

We digress in this paragraph to show that the order of the non-abelian finite simple 
group T is divisible by 4. It seems to be well-known that this assertion follows immediately 
from the Feit-Thompson Theorem which states that |T| is even. The following simple 
argument was showed to us by Michael Giudici in private communication. Recall that the 
right-regular representation g of T is a homomorphism from T to Sym T that maps t G T 
to the permutation g(t) G SymT where g(t) is defined by the equation xg(t) = xt for all 
x G T. It is easy to see that g{T) is a regular subgroup of Sym T; that is g(T) is transitive, 
and, for all t G T \ {1}, g(t) has no fixed-points. Now g{T) = T and g(T) n AltT is a 
normal subgroup of g{T) with index at most 2. Thus g{T) ^ Alt T, and so every element 
of g(T) is an even permutation on T. By the Feit-Thompson Theorem referred to above, 
we have that T contains an involution g. Since g(g) is also an involution, it must be 
the product of disjoint transpositions. As g{g) is an even permutation, the number of 
transpositions in g(g) must be even. Further, as g(g) has no fixed-points, every element 
of T must be involved in precisely one of these transpositions. This implies that 4 | \T\, 
as claimed. 

We now continue with the main thrust of the proof. In order to derive a contradiction, 
we show that the equations for s, t and \T\ above imply that 4 { \T\. Indeed, note that 
st is a square, and so, as gcd(s, t) = 1, we have that t must be a square. If 4 divides \T\ 
then t = s\T\ + |T| — 1 = 3 (mod 4). However, 3 is not a square modulo 4, which gives the 
desired contradiction. Hence, in this case, G cannot be primitive with type SD or TW. □ 

The reader may wonder whether it is possible for an abstract group G to have two 
faithful primitive permutation actions, one with type TW and one with type SD. Gross 
and Kovacs in [6] show that if G is a twisted wreath product of A5 and Aq where the 
twisting subgroup in /Kq is isomorphic to A5, then G is isomorphic to the straight wreath 
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product A 5 wr A 6 . Hence in this case G can be a primitive permutation group of type TW 
and also of type SD. 

Now we can prove Theorem 14. 1L 

Proof of Theorem 14.11 Suppose that G is a point-primitive, line-primitive and flag- 
transitive group of automorphisms of a generalized hexagon or octagon. Using parts (i)- 
(iii) of Lemma 14.21 we obtain that the type of G on both the points and lines must be 
AS. In particular G, as an abstract group, must be almost simple. □ 

5 Hexagons and octagons with an almost simple au- 
tomorphism group 

In this section we prove the following theorem. 

Theorem 5.1 If S is a generalized hexagon or octagon and G is a flag-transitive and 
point-primitive automorphism group of S, then G is not isomorphic to an alternating or 
symmetric group with degree at least 5. 



Our strategy to prove Theorem 15.11 is to show that a maximal subgroup of an alter- 
nating or symmetric group cannot be a point-stabilizer. To carry out this strategy, we 
need some arithmetic results about the maximal subgroups of A n and S n . 

Lemma 5.2 // n 6N and n ^ 107 then 



Proof. Checking the numbers between 107 and 208, we can see that ([T]) holds for all 
n G {107, . . . , 208}. So suppose without loss of generality in the remaining of this proof 
that n is at least 209. The Stirling Formula gives, for each n ^ 1, that there is d n G [0, 1] 
such that n\ = (n/e) n \ / 2'ime l}n ^ 12n ^ (see [TUl Theorem 2, Chapter XII]), which gives that 
(n/e) n ^ n\/2. We claim that n n l 2 ^ {n/e) n for n ^ 8. Easy calculation shows that the 
inequality holds for n = 8. We assume that it holds for some n and prove by induction 
that it holds for some n+1. Let us compute that 



n 




(1) 




and 



(fo + iVg) 

(n/e) n 



n+1 




2n 



12 



This shows that 

( n+1 )(n+i)/2 ^ (( n + i)/e) n + 1 
n n/2 ^ (n/e) n ' 

and the assumption that n n l 2 ^ [n/e) n gives the claimed inequality for n + 1. Therefore 
it suffices to show that n 12+12 ^ log2n ^ ^ n n ^ 2 , and, in turn, we only have to show that 
12 + 121og 2 n ^ n/2 for n ^ 209. Again, easy computation shows that the inequality 
holds for n = 209. Since x i— > 12 + 12 log 2 x is a concave function and x i— > x/2 is a linear 
function, the inequality must hold for all n ^ 209. □ 



Lemma 5.3 Suppose that G is an alternating or symmetric group with degree n (n ^ 5) 
and H is a primitive and maximal subgroup of G such that \H\ 12 \G\. Then G and H 
must be as one of the groups in the table of Appendix\M 

Proof. Suppose that if is a primitive and maximal subgroup of G. Using the classifi- 
cation of maximal subgroups of the alternating and symmetric groups pj] and Maroti's 
Theorem [13| Theorem 1.1], we have that one of the following must hold: 

(1) n = k for some k ^ 5 and £ ^ 2 and H is permutationally isomorphic to (Sjt wr S^) n 
G in product action; 

(2) G is isomorphic to M„ for n 6 {11, 12, 23, 24} in its 4-transitive action; 

(3) |G| < n 1+ ^ n K 

Suppose that case (1) is valid and let H be permutationally isomorphic to the group 
(Sfc wr Si) fl G in product action for some k ^ 5 and £ ^ 2. Then we obtain that 

\H\ 12 ^(k\) 12£ -(£\) 12 . 

We claim that {k\) 121 • (£\) 12 < {k)\/2 except for finitely many pairs (k,£). First note 
that all primes p dividing (k\) 12£ ■ (£\) 12 will also divide (Ar)!/2. For an integer x, let \x\ p 
denote the largest non-negative integer a such that p a \x. It suffices to show that, there 
are only finitely many pairs (k,£) such that \(k\) 12e ■ (^!) 12 | p ^ |(Ar)!/2| p , where p is an 
arbitrary prime which is not greater than max{fc, £}. It is routine to check that if x is an 
integer then 



\x\ 



p 

u=l 



oo oo 

X p X 



Ju ^ V > Ju Ju % > 1 

pU ^ , n U ^ ^1 



pU p P — 1 



Thus 
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Clearly, k e $z 8. Further, as k ^ 5, i ^ 2, and p ^ max{fc,£}, we obtain that p 2 Si k . 
Hence we obtain from the first equality in ([2]) that 

lM!/2|p> 

Routine computation shows that the set of pairs (k, £) for which k ^ 5 and £ ^ 2 and 
24£A; + 24£ ^ fc* is {5, . . . , 48} x {2} U {5, . . . , 8} x {3}. Then checking finitely many 
possibilities it is easy to compute that (k\) 12£ ■ (£!) 12 ^ (k £ )\/2 if and only if (k,l) G 
{5, . . . , 10} x {2}. In particular, the degree of H is at most 100. 

(2) Easy computation shows that |M„| 12 > n\/2 for n G {11, 12,23,24}. 

(3) Lemma E2] shows that if n ^ 107 then n 12 +i2Li°g 2 «J ^ n! / 2 . Hence if n > 107 
and if is a maximal subgroup of A n or S n which is as in part (3) of the theorem, then 
|if| 12 < n\/2. Thus, in this case, the degree of H must be at most 106. 

Summarizing the argument above: if if is a primitive maximal subgroup of G such 
that |ii| 12 |G| then the degree of H is at most 106. It remains to prove that H must be 
one of the groups in the table in Appendix Various classifications of primitive groups 
of small degree can be found in the literature; for convenience we use the classification 
by Roney-Dougal [15], as it can be accessed through the computational algebra system 
GAP [17J. In what follows we explain how we obtained the table in Appendix lAl using 
the GAP system. First, for a fixed n G {5, . . . , 106}, let P n denote the list of of primitive 
groups with degree n. For H G P n we check whether or not H ^ A n . Then we check 
whether |if| 12 #5 \G\ where G is either A n (if H ^ A n ) or S n (otherwise). If H satisfies 
this condition then we keep it in P n , otherwise we erase it from P n . The next step 
is to eliminate those groups which are clearly not maximal subgroups in A n or S n . If 
Hi, H 2 G P n such that Hi, H 2 ^ A n and Hi < H 2 then Hi is erased from P n . Similarly, 
if Hi, if 2 A n such that Hi < H 2 , then Hi is thrown away. We do this calculation for 
all n G {5, . . . , 106} and the subgroups H that we obtain are in Appendix [A] □ 

Let us note that Lemma [5.31 is not an "if and only if" statement. Indeed, the table 
in the appendix may be redundant in the sense, that a subgroup in the table may not be 
maximal in A n or S n . 

Let us now prove Theorem 15.11 

Proof of Theorem 15.11 Suppose that S = (V, C, I) is a generalized hexagon or 
octagon and G is a point-primitive, flag-transitive automorphism group of S such that G 
is isomorphic to A n or S n with some n ^ 5. By Buekenhout and Van Maldeghem [2], we 
may assume that n ^ 14. Let x G V . Then G x , as a subgroup of S n , is either intransitive, 
or it is transitive and imprimitive, or it is primitive. We consider these three cases below. 
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G x is intransitive. Here, G x is the stabilizer in G of a partition of the underlying 
set into two blocks, one with size k and one with size £, where k + £ = n, k ^ £. Let 
us also allow here the case when k — £, though in this case G x may not be intransitive. 
Assume without loss of generality that k ^ £. Then G x contains a subgroup isomorphic to 
(Afc x A^) XC2. Hence the points of S can be labelled with the subsets of {1, 2, . . . , n} of size 
k. We may label x as {1, 2, ... , k}. Let k\ < k be maximal with the property that there 
is a point y of S collinear with x and the label of y intersects {1, 2, . . . , k} in ki elements. 
Without loss of generality, we may assume that y ~ x has label {1,2,..., k±, k+1, . . . , 2k — 
ki}. First suppose that k\ — k — 1. Note that, since the permutation rank of G is at 
least 4, we may assume k ^ 3. By transitivity of G x on {1,2, ... ,k}, and by transitivity 
of the pointwise stabilizer of {1,2,..., k} on the complement {k + 1, k + 2, . . . , n}, every 
point with a label sharing exactly k — 1 elements with {1,2,..., A;} is adjacent with x. 
An arbitrary element g of now maps y onto a point y' with label, without loss of 
generality, either {1, 2, . . . , k - 1, k + 2} or {2, 3, . . . , k, k + 1} or {2, 3, . . . , k, k + 2}. In 
the first two cases y' is collinear with y. Since, by flag-transitivity, we can choose g such 
that it does not preserve the line xy, and hence does not map the point y onto a collinear 
point, we may assume that the point y' with label {2, 3, . . . , k, k + 2} is not collinear with 
y, and hence has distance 4 to y (in the incidence graph). But now the automorphism 
(1 k + l)(k k + 2) (if k' = k + 1) fixes both y and y', but not x = y\x\y" '. Hence k\ <k-l. 

Now the automorphism {k — 1 &;)(&; + 1 2/c — fci + 1) belongs to G x and maps y to 
a point 2 whose label shares k — 1 elements with y. Hence z cannot be collinear with y 
(otherwise, mapping y to x, the image of z produces a point with a label contradicting 
the maximality of k\ which is less than k — 1). On the other hand, z is collinear with 
x. If ki > 0, then the automorphism (1 k + 2) (k — 1 k) belongs to G, preserves y and 
z, but not x = yxz. Now suppose that k\ — 0. If 2k + 1 < n, then the automorphism 
(1 2k + 2)(2 3) fixes y and z, but not x = yxz, a contradiction. If 2k + 1 = n, then, by the 
maximality of k\, and the transitivity of A k , we see that there are precisely k + 1 points 
collinear with x on which G x acts 2-transitively. This easily implies that either s = 1 or 
t = 0, either way a contradiction. 

G x is imprimitive. Here is the stabilizer of a partition of the underlying set into 
£ blocks each with size k. Let 1 be a point of S, which we may assume without loss 
of generality to correspond to the partition of {1,2, ... ,n} into £ subsets of size k given 
by {ik + 1, ik + 2, . . . , ik + k}, ^ i < £. We may assume that £ > 2, the case £ = 2 
being completely similar to the intransitive noticed above. (If £ = 2 then, as the 

number of point is greater that 4, we may also assume that k ^ 3). 

We first claim that there is some point y ~ x such that y corresponds to a parti- 
tion sharing at least one partition class with x (we will identify the points with their 
corresponding partition). Let y be any point collinear with x and suppose that y has 
no partition class in common with x. If k = 2, then £ > 6 and so the automorphism 
(1 2) (3 4) destroys at most 4 classes of y, while it fixes x. Hence the image z of y has at 



15 



least three classes {ii, i 2 }, {13, 24}, {25, i&} in common with y, and therefore we may assume 
that y rfj z. The group generated by [i\ 22) (*3 ii), (ii ^3)^2 h) and (ii 25)^2 io) fixes both 
y and z but cannot fix x, a contradiction. Suppose now k > 2. Then the automorphism 
(1 2 3) destroys at most 3 classes of y and maps y to a point z sharing at least £ — 3 classes 
with y. This is at least one if £ > 3. If £ = 3, then k > 3 and hence some class of y shares 
at least two elements with some class of x. Without loss of generality, we may assume 
that 1, 2 are in some class of y and hence the automorphism (12 3) destroys at most two 
classes of y, resulting in the fact that z shares at least one class with y again. Let this 
common class be given by i 2 , 13-, • • •}, where we may suppose without loss of generality 
that ii,t2,h do not belong to a common class of x. The automorphism (ii 12 13) fixes 
both y and z, but not x = ywz, a contradiction. Our claim is proved. 

Now let £\ be maximal with respect to the property that there exist two collinear 
points sharing £\ classes. By the foregoing, £\ > 0, and we may assume that the class 
{1,2,..., k} belongs to the point y ~ x. Suppose that £\ < £ — 2. In particular, it follows 
from our assumptions that £ ^ 4. It also follows from our assumptions that there is 
a transposition (j\ j 2 ) fixing x and not fixing y. Hence the automorphism (1 2)(j 1 j 2 ) 
preserves x and maps y to a point z sharing £ — 2 classes with y. By the maximality of 
£1, we see that y z. Also, y and z contain a common class which is not a class of x. So 
there exist elements J3, J4 contained in a common class of both y and z, but belonging to 
different classes of x. The automorphism (1 2)(j 3 jf) fixes y and z, but not x = yMz, a 
contradiction. We have shown that £\ = £ — 2, and this now holds for all £ ^ 3. 

Now let k\ be the maximal number of elements in the intersection of two distinct 
classes of two collinear elements sharing £ — 2 classes. Note that k\ ^ k/2 > 0. First 
we show that k\ < k — 1. So we assume by way of contradiction that k± — k — 1. By 
transitivity of G x , every point with a partition sharing £ — 2 classes with x and for which 
the distinct classes share k — 1 elements, is collinear with x. By flag-transitivity and 
thickness, at least two such points y', y" are not collinear with y. If the different classes of 
y' (compared with the classes of x) are the same as those of y, then, for k > 2, the same 
arguments as in the intransitive case lead to a contradiction. For k = 2, y" does not have 
this property (since there are only three points with £ — 2 given partition classes), and we 
switch the roles of y' and y" in this case. So y' differs from y in three or four classes. We 
distinguish between two possibilities. 

(1) y and y' differ in exactly three partition classes. We may assume that y contains 
the classes {1, 2, ... , k — 1, k+1} and {k, k + 2, k+3, . . . , 2k} (and the other classes coincide 
with classes of x). Without loss of generality, there are two possibilities for y' . Either y' 
contains the classes {1, 2, . . . , k — 1, 2k + 1} and {k, 2k + 2, 2k + 3, . . . , 3k} (and the other 
classes coincide with classes of x), or y' contains the classes {1, 2, . . . , k — 2, k, 2k + 1} and 
{k — 1, 2k + 2, 2k + 3, . . . , 3k} (and the other classes coincide with classes of x). In the 
first case the automorphism g — (k + 1 2k + 1 k) maps y onto y', and y' onto a point 
collinear with x. Since y'g is not collinear with yg = y', we see that g must preserve 
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ywy' = ygwy'g = x. But it clearly does not, a contradiction. In the second case the 
automorphism (k — 1 2k + l)(k k + 1) interchanges y with ?/, but does not fix x = yny 1 ', 
a contradiction. 

(2) Hence y and y' differ in four partition classes. We take y as in (1), and we can 
assume that y' contains the classes {2k + 1, 2k + 2, ... ,3k — 1,3k + 1} and {3k, 3k + 2, 3k + 
3, . . . , 4k}. Now the automorphism (k k + 1) (3k 3k + 1) interchanges y with y' without 
fixing x = ywy', a contradiction. 

Hence we have shown k\ < k — 1. But now the rest of the proof is similar to the last 
paragraph of the intransitive case, where the subcase k\ = cannot occur. We conclude 
that G x is primitive on {1,2,..., n}. 

G x is primitive. By Lemma l3.2( v). \G\ ^ (G^l 12 , and so Lemma 15.31 implies that G 
and G x must be in the table of Appendix lAl Set u = \V\ = \G : G x \ and let a{u) and 
b(u) be the quantities defined before Lemma [3.11 Then Lemma [3.11 implies that if S is a 
hexagon then a(u) 3 ^ u and, if S is an octagon, then b{u) 2 ^ u. For each pair [G, G x ) 
in Appendix |Aj one can compute using, for instance, the GAP computational algebra 
system, the quantities u, a{u), and b{u). The computation shows that a(u) 3 > u and 
b{u) 2 > u holds in each of the cases. The computation of a(u) and b{u) are presented in 
Appendices [B] and O Therefore none of the groups in Appendix [X] can occur, and so we 
exclude this well. 

Thus G cannot be an alternating or symmetric group. □ 

Now we can prove our main theorem. 

Proof of Theorem 12.11 Suppose that S and G are as in the theorem. Then Theo- 
rem SJ] implies that G must be an almost simple group. Let T denote the unique minimal 
normal subgroup of G. Note that T is a non-abelian simple group. By [2], T cannot be a 
sporadic simple group, and by Theorem 15. \\ T cannot be an alternating group. Thus T 
must be a simple group of Lie type and G must be an almost simple group of Lie type. □ 

6 Directions of future work 

Now that Theorem 12.11 is proved, the next step in the full classification of generalized 
hexagons and octagons satisfying the conditions of Theorem 12.11 is to treat the class of 
almost simple groups of Lie type. It is not our intention to be as detailed as possible 
regarding these groups, as we think the only worthwhile job now is to complete the 
classification in full. We noted in the proof Lemma 14.21 that in a generalized octagon 
either the number of points or the number of lines is odd. Therefore it is meaningful 
to investigate which almost simple groups of Lie type with odd degree can occur in 
Theorem 12.11 Another possible task is to use Lemma 13.21 to characterize the case when 
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the parameters are not co-prime. We conclude this paper by presenting a couple of 
examples to illustrate that Lemmas 13.11 and 13.21 can be used, to some extent, in this 
direction. However, our examples also show that a complete treatment of these groups is 
beyond the scope of this paper and will probably require new ideas. 

Let us assume that G is an almost simple group of Lie type with socle T and that 
G is a group of automorphisms of a generalized hexagon or octagon S = (V, C) acting 
primitively both on the point set and on the line set, and transitively on the set of flags. 
Suppose, in addition, that the number \V\ of points is odd and let x be a point. The 
possibilities for T and the point stabilizer T x can be found in P, [12] . One possibility, for 
instance, is that q = 3 2m+1 with some m ^ 1, T = 2 G2{q) and \T X \ = q(q 2 — 1). We claim 
that it follows from our results that this case cannot occur. Note that \V\ = q 2 (q 2 — q+1). 
If S is a hexagon, then Lemma [3.11 implies that a(q 2 {q 2 — q + l)) 3 ^ q 2 {q 2 ~ q + 1) (the 
function a is defined before Lemma l3.ip . However, a(q 2 (q 2 — q + l)) 3 ^ 31201+3 
would imply that 3 12m + 3 ^ 38m+4 w j 1 i c j 1 d oes no t hold for m ^ 1. Thus such a hexagon 
does not exist, and similar argument shows that neither does such an octagon. 

Another case is that T = F 4 (g), \T X \ = q w {q 2 - l)(g 4 - l)(g 6 - l)(g 8 - 1), and so 
\V\ = q s (q s + q 4 + 1). Computer calculation shows that among the prime-powers that 
are smaller then 10 4 , there are 626 values of q such that ad^l) 3 ^ \V\, and there are 625 
such values with b(\V\) 2 ^ \V\. Therefore Lemma |3~T1 cannot directly be used to exclude 
this case. 

We conclude this paper with an example that shows how Lemma T3.2I may be applied. 
Let S = (V, C) be as above and let us assume that the parameters s and t of S are 
not co-prime. By Lemma [3.2( ii). an involution in G either fixes a point or fixes a line. 
Now if G is isomorphic to A„ or S„ with some n ^ 5, then, by possibly taking the dual 
polygon, we may assume that a double transposition (in the natural representation of G) 
is contained in a point stabilizer G x . Therefore, as a subgroup of S n , G x has minimal 
degree at most 4 (see [H page 76] for the definition of the minimal degree). Now if G x 
is primitive then [U Example 3.3.1] shows that n ^ 8, and hence G is ruled out by [2]. 
This argument shows that under the additional condition that gcd(s,t) 7^ 1, the proof of 
Theorem 15.11 can be significantly simplified. 
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Appendix A Table 1 



The following table contains the primitive maximal subgroups H of A n and S n (n ^ 5) 
such that \H\ 12 ^ n! and \H\ 12 ^ n\/2 if H ^ A n . Note that the table may contain 
non- maximal subgroups; see the remarks at the end of the proof of Lemma I5U1 The table 
was automatically generated from a GAP output, and so the notation follows the GAP 
system. 



CC5) ^ A 5 


D(2*5) ^ A 5 


AGLC1 , 5) ^ S 5 


PSLC2.5) $ A 6 


PGL(2,5) S 6 


7:3 ^ Ay 


L(3, 2) ^ Ay 


AGLCl, 7) ^ S 7 


ASL(3, 2) ^ A s 


PSLC2, 7) ^ Ag 


PGL(2, 7) ^ S 8 


3"2: (2'A(4)) < Ag 


PGammaL(2, 8) ^ A 9 


AGLC2 , 3) ^ S 9 


a(5) s; An, 


MUO) ^ A 10 


SC5) SC Sio 


PGammaL(2, 9) ^ Sio 


11:5 < An 


M(ll) < An 


AGLC1 , 11) ^ Sn 


M(ll) ^ A 12 


M(12) ^ A 12 


PSLC2, 11) ^ A 12 


PGL(2, 11) ^ S12 


13:6 ^ A 13 


L(3, 3) ^ A13 


AGLCl, 13) < Si 3 


PSLC2.13) ^ A 14 


PGLC2.13) ^ S14 


PSL(4, 2) ^ A i5 


2 _ 4.PSL(4, 2) ^ A 16 


17:8 ^ A 17 


LC2, 2"4) :4 - PGammaL(2, 2"4) ^ A 17 


AGLCl , 17) ^ S17 


PSLC2.17) ^ A 18 


PGLC2.17) < Sia 


19:9 ^ A 19 


AGL(1, 19) < S19 


PSLC2.19) ^ A 2 


PGLC2.19) < S 2 


A(7) sC A 2 i 


PGL(3, 4) ^ A 2 i 


PGLC2, 7) S 2 1 


S(7) $ S 2i 


PGammaLO, 4) ^ S21 


MC22) ^ A 2 2 


M(22):2 $ S 22 


23:11 ^ A23 


M(23) < A 23 


AGLCl , 23) < S23 


M(24) SC A 24 


PSL(2, 23) ^ A 2 4 


PGLC2, 23) ^ S 24 


ASL(2, 5) :2 A 2 b 


(A(5) x A(5)):2"2 < A 25 


AGLC2, 5) < S25 


(S(5) X SC5)):2 S25 


PSigmaL(2, 25) ^ A 2 e 


PGammaL(2, 25) ^ S26 


ASLC3, 3) ^ A 2 7 


PSp(4, 3) :2 ^ A27 


AGLC3, 3) ^ S 27 


PGanraiaLC2, 8) ^ A 28 


PGammaUO, 3) < A 2 s 


PSp(6, 2) ^ A 28 


S(8) < A 28 


PSLC2, 27) :3 ^ A 28 


PGammaL(2, 27) ^ S 2 8 


29:14 ^ A29 


AGL(1 , 29) ^ S 29 


PSL(2,29) ^ A30 


PGL(2,29) sC S30 


LC3, 5) ^ A 31 


L(5, 2) ^ A 31 


AGLCl, 31) < S31 


ASLC5, 2) ^ A 32 


PSL(2, 31) ^ A32 


PGL(2, 31) ^ S32 


PGanraiaL(2, 32) ^ A33 


s(s) s; a 35 


PGammaUC3, 3) ^ A 36 


PSp(4, 3) :2 ^ A 36 


PSp(6, 2) ^ A 36 


AC9) s; A 36 


SC9) < S 36 


(S(6) x S(6)):2 s; S 36 


CSC5) X SC5)):2 ^ S 36 


PSLC2.37) ^ A 38 


PGL(2,37) < S 38 


PSp(4, 3) :2 < A 40 


PSp(4, 3) ^ A 40 


PSL(4, 3) ^ A 40 


PSp(4, 3):2 < S 40 


PGL(4, 3) < S 40 


PSL(2,41) ^ A42 


PGLC2.41) ^ S42 


PSLC2.43) ^ A44 


PGLC2.43) ^ S44 


S(10) ^ A 45 


PSp(4, 3):2 < S 45 


CAC7) x A(7)):4 A 40 


CS(7) X S(7)):2 s: S49 


PSD(3, 5) :2 ^ A 50 


Alt(ll) < A55 


Sym(ll) ^ S55 


PSL(3, 7) .3 < A57 


PSL(6, 2) ^ A 63 


AGLC6, 2) ^ A 6 4 


Sym(8) wreath Sym(2) ^ A 64 


Sym(12) < A 66 


Sym(13) S 78 


Alt(9)-2.2"2 A s i 


Sym(9) wreath SymC2) ^ S 8 i 


SymCIO) wreath SymC2) ^ S100 
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Appendix B Table 2 



The following table contains the values of u and a(u) where u — \G : H\, G and H are 
as in Appendix |Al and degG = degH ^ 14. One can read off that in each of the cases 
a(u) 3 > u, which implies that G cannot be an automorphism group of a flag-transitive 
generalized hexagon with point stabilizer H . See the proof of Theorem 15. II 



PSL(2,13) ^ A 14 


PGL(2,13) ^ S14 


PSLC4, 2) ^ A 15 


2"4.PSL(4, 2) ^ A 16 


n C.\3 ^ f- Qt? 1(il8 


n (f,,\ 3 ' — f\ sr . in^8 

Ctl (1 J ~ O.oO J-U 


n{n\ 3 ' — 1 «7 . 

CI 1 LL J l.D 1 J.U 


n [f,,\ 3 ~ 1 K7 . 

LL I LL 1 l.DI J.U 


u S3 3.99 ■ 10 7 


w S3 3.99 ■ 10 7 


u S3 3.24 ■ 10 7 


u w 3.24 ■ 10 7 


17:8 < A17 

n(n\3 r^. O OA . 10^6 
LL \ tl ) /-^t O . ZAJ J-U 


L(2, 2"4):4 = PGammaL(2, 2~4) ^ A 17 

n(ii\3 ~ 1 OR . in20 

ft I tt J r * l.OU 1U 


AGLCl, 17) ^ Sir 
LL \ u, ) <~-/ o . ^ yj I. yj 


PSLC2.17) ^ A iS 


u S3 1.30 ■ 10 12 


U 1=3 1.08 ■ 10 10 


u ss 1.30 ■ 10 12 


u S3 1.30 ■ 10 12 


PGL(2,17) ^ Sis 

Ct l Lt J ' — ■ O . Z U ■ i. U 


19:9 ^ A 19 

n /„l3 /; ia33 


AGLCl, 19) ^ S19 

cl \ ti t i^~> yj . ^±^± - ±u 


PSLC2.19) ^ A 2 o 

„(',,'|3 ^ t- ^i* in33 


u S3 1.30 ■ 10 12 


u S3 3.55 ■ 10 14 


u K3 3.55 ■ 10 14 


u =3 3.55 ■ 10 14 


PGLC2.19) ^ S 20 

LL\ tl I . £ ± e ± ' ±\J 


A(7) ^ A 21 

n(n\^ ~ 9 17 . in^^ 

ti I LL 1 r-^J Z . L 1 ' ±U 


PGLC3, 4) ^ A 2 i 
n/,.\3 i C7 ia30 


PGLC2, 7) ^ S 2 l 
LL\LLj <~-/ i . o^± 1U 


u S3 3.55 ■ 10 14 


U S3 1.01 • 10 16 


u S3 4.22 ■ 10 14 


•u =3 1.52 ■ 10 17 


a(u) 3 S3 2.17 • 10 34 


PGanunaLO, 4) ^ S 2 l 
a(u) 3 S3 1.57 ■ 10 30 


Mf991 < Ann 

a(u) 3 S3 4.25 ■ 10 31 


Mf99l ■ 9 < Son 

a(u) 3 S3 4.25 ■ 10 31 


u S3 1.01 • 10 16 


u S3 4.22 ■ 10 14 


u S3 1.26 ■ 10 15 


u S3 1.26 ■ 10 15 


23:11 sS A 23 
a(u) 3 S3 8.12 • 10 42 


M(23) ^ A 23 
a(u) 3 S3 4.25 ■ 10 31 


AGLCl, 23) ^ S 23 
a(u) 3 S3 8.12 ■ 10 42 


M(24) ^ A 24 
a(u) 3 S3 4.25 ■ 10 31 


u a 5.10 ■ 10 19 


u S3 1.26 • 10 15 


u S3 5.10 • 10 19 


u S3 1.26 ■ 10 15 


PSLC2, 23) ^ A 2 4 
a(u) 3 S3 8.12 ■ 10 42 


PGLC2, 23) ^ S 24 
a(ll) 3 S3 8.12 • 10 42 


ASLC2, 5) :2 ^ A 25 
a(u) 3 S3 1.31 ■ 10 47 


(A(5) x A(5)) :2"2 ^ A 25 
a(u) 3 S3 9.51 ■ 10 45 


u S3 5.10 ■ 10 19 


u S3 5.10 • 10 19 


u S3 1.29 ■ 10 21 


u S3 5.38 ■ 10 20 


AGLC2, 5) ^ S 25 
a(u) 3 S3 1.31 • 10 47 


(S(5) X S(5)):2 S 25 
a(u) 3 S3 9.51 ■ 10 45 


PSigmaL(2, 25) ^ A 26 
a(u) 3 S3 1.31 ■ 10 50 


PGammaLC2, 25) < S 2 e 
a(u) 3 S3 1.31 ■ 10 50 


11 S3 1.29 ■ 10 21 


u S3 5.38 ■ 10 20 


u S3 1.29 ■ 10 22 


u S3 1.29 ■ 10 22 


ASLC3, 3) ^ A 2 7 
a(u) 3 S3 2.81 ■ 10 51 


PSp(4, 3) :2 ^ A 27 
a(u) 3 S3 3.21 ■ 10 49 


AGLC3, 3) ^ S 27 
a(u) 3 S3 2.81 ■ 10 51 


PGaramaLC2, 8) ^ A 28 
a(u) 3 S3 2.84 • 10 58 


u S3 3.59 ■ 10 22 


u S3 1.05 ■ 10 23 


u S3 3.59 ■ 10 22 


u S3 1.00 ■ 10 26 


PGammaUO, 3) ^ A 2S 
a(u) 3 S3 5.54 ■ 10 65 


PSp(6, 2) ^ A 28 
a(u) 3 S3 3.21 ■ 10 49 


S(8) ^ A 28 
a(u) 3 S3 1.49 ■ 10 54 


PSL(2, 27) :3 ^ A 2S 
a(u) 3 S3 8.41 ■ 10" 


u S3 1.26 • 10 25 


u S3 1.05 ■ 10 23 


u S3 3.78 ■ 10 24 


u S3 5.17 ■ 10 24 
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PGammaLC2, 27) ^ S28 
a(u) 3 fs 8.41 • 10 57 
u fa 5.17 • 10 24 



29:14 ^ A 2 g 
a(u) 3 S3 3.57 • 10 6 
u S3 1.08 • 10 2S 



AGLCl, 29) ^ S29 
a(u) 3 Fs 3.57 ■ 10 64 
u FS 1.08 ■ 1() 2S 



PSLC2.29) ^ A 30 
a(u) 3 FS 3.57 ■ 10 64 
u fB 1.08 • 1() 2S 



PGU2.29) s£ S 30 
a(u) 3 fs 3.57 • 10 6 ' 
u FS 1.08 ■ 10 2S 



L(3, 5) ^ A 31 
a(u) 3 S3 1.09 • 10 6 
u Fs 1.10 • 1() 2S 



L(S, 2) $ A31 
a(u) 3 S3 1.92 ■ 10 6 
u » 4.11 ■ 10 26 



AGLCl, 31) ^ S31 

a(u) 3 S3 5.58 ■ 10™ 
u S3 8.84 ■ 10 30 



ASL(5, 2) ^ A32 
a(u) 3 S3 1.92 • 10 61 
u S3 4.11 • 10 26 



PSL(2, 31) ^ A 32 
a(u) 3 S3 5.58 • 10 70 
u S3 8.84 ■ 1() 30 



PGL(2, 31) < S32 
a(u) 3 S3 5.58 ■ 10 7C 
u S3 8.84 • 1() 30 



PGammaL(2, 32) ^ A33 
a(u) 3 S3 1.50 • 10 72 
u S3 2.65 • 1() 31 



S(8) ^ A35 
a(u) 3 S3 5.70 • 10 7 
u S3 1.28 ■ 10 35 



PGammaUC3, 3) ^ A 36 
a(u) 3 S3 9.86 ■ 10 84 
u S3 1.53 • 10 37 



PSp(4, 3): 2 ^ A 3 e 
a(u) 3 S3 3.65 ■ 10 r 
u S3 3.58 ■ 10 : 
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PSp(6, 2) sC A 36 
a(u) 3 S3 5.70 ■ 10 78 
u S3 1.28 ■ 10 35 



A(9) ^ A 36 
a(uf S3 2.92 • 10 81 
u S3 1.02 ■ 10 36 



SC9) $ S 36 
a(u) 3 S3 2.92 ■ 10 81 
u S3 1.02 ■ 1() 36 



(S(6) x S(6)):2 S 36 
a(u) 3 S3 3.65 • 10 77 
u S3 3.58 ■ 10 35 



CSC5) x S(5)):2 S 36 
a(u f S3 1.70 • 10 82 
u S3 1.29 ■ 10 37 



PSLC2.37) A 38 
a(uf S3 8.72 • 10 90 
u S3 1.03 • 10 40 



PGL(2,37) ^ S 38 
a(uf S3 8.72 • 10 90 
u fa 1.03 ■ 10 40 



PSp(4, 3) :2 ^ A 40 
a(u) 3 S3 5.05 • 10 87 
u S3 7.86 • 10 42 



PSp(4, 3) < A 40 
a(u) 3 S3 4.04 • 10 81 
u S3 1.57 ■ 10 43 



PSLC4, 3) ^ A 40 
a(u) 3 S3 6.92 ■ 10 84 
u S3 6.72 ■ 10 40 



PSp(4, 3) :2 sC S. 
a(u) 3 S3 4.04 • 10' 
u S3 1.57 ■ 10 43 
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PGLC4, 3) S 40 
a(u) 3 S3 6.92 ■ 10 84 
u S3 6.72 • 10 40 



PSLC2.41) < A 42 



u S3 2.03 • 10* 



PGL(2,41) < S 42 



u S3 2.03 ■ 10* 



PSLC2.43) ^ A44 
a(uf S3 3.87 ■ 10 107 
u S3 3.34 • 10 49 



PGL(2,43) ^ S44 
a(u) 3 S3 3.87 ■ 10 107 
u S3 3.34 ■ 10 49 



u S3 1.64 • 10 4 



PSp(4, 3):2 5j S45 
a(uf S3 4.66 • 10 105 
u S3 2.30 ■ 10 51 



(A(7) x A(7)):4 s£ A 49 



u S3 1.19 ■ 10° 



CSC7) x S(7)):2 < S49 
a(uf S3 6.52 ■ 10 116 
u S3 1.19 ■ 10 55 



PSDC3, 5) :2 ^ A 50 



11 S3 6.03 • 10° 



Alt(ll) A 55 
a(uf S3 1.62 • 10 142 
u S3 3.18 ■ 10 65 



Sym(ll) sC S 5S 
a(u f S3 1.62 • 10 142 
u S3 3.18 • 10 65 



PSL(3, 7) .3 ^ A57 
a(uf S3 8.06 ■ 10 156 
u S3 3.59 ■ 10 69 



PSLC6, 2) sg A 63 
a(u) 3 S3 1.12 ■ 10 164 
u S3 4.91 • 1() 76 



AGLC6, 2) ^ A 64 
a(uf S3 1.12 ■ 10 16 
u S3 4.91 • 10 76 



SymC8) wreath SymC2) ^ A 64 
a(u f S3 2.35 ■ 10 167 
it S3 1.95 ■ 1() 79 



SymC12) $ A 66 
a(u) 3 S3 7.71 ■ 10 1 
u S3 5.68 ■ 10 83 



Sym(13) $ S 78 
a(u) 3 S3 5.28 • 10 2 
u S3 1.81 ■ 10 105 



Alt(9)"2.2-2 ^ A sl 
a(-ti) 3 S3 2.97 ■ 10 22[ 
u S3 2.20 ■ 10 109 



SymC9) wreath Sym(2) ^ Ssi 
a(u) 3 S3 2.97 ■ 10 220 
u S3 2.20 ■ 10 109 



SymCIO) wreath Sym(2) ^ S100 
a(uf S3 2.74 ■ 10 293 
u S3 3.54 ■ 10 144 
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Appendix C Table 3 



The following table contains the values of u and b(u), where u = \G : H\, G and H are 
as in Appendix [A] and degG = degH ^ 14. One can read off that in each of the cases 
b(u) 2 > u, which implies that G cannot be a automorphism group of a flag-transitive 
generalized octagon with point stabilizer H. See the proof of Theorem 15.11 



PSL(2,13) ^ A 14 

U{ t± I O.D1 1U 

u w 3.99 ■ 10 7 


PGLC2.13) < S14 

h(iA 2 ~ ^ fii . 

1 LL J 1U 

w S3 3.99 ■ 10 7 


PSLC4, 2) ^ A 15 
h(n\ 2 — 1 41 . 1 nio 

L) I LL I L . ~± L L U 

u « 3.24 ■ 10 7 


2"4.PSL(4, 2) ^ A 16 

hln\ 2 ~ 1 41 . i nio 

UILL) L .-±1 ± U 

u 1=3 3.24 • 10 7 


17:8 ^ A17 
h(n\^ ~ A RS . in^ 

u\ LL I r — i £± . t)o 1U 

u w 1.30 ■ 10 12 


L(2, 2~4):4 = PGammaL(2, 2~4) ^ A 17 

hfii~\-^ cy ^ 9^ . Ifl^ 

u\U. ) /-^ O . Z □ 1U 

u 1=3 1.08 ■ 10 10 


AGLCl, 17) ^ Sir 
u ss 1.30 ■ 10 12 


PSLC2.17) ^ Aig 
h( ~ a fis . 
u ss 1.30 ■ 10 12 


PGL(2,17) ^ Sis 
h(n\^ ~" A RS . in^ 

U\ LL I r * ^.UO 1U 

u w 1.30 ■ 10 12 


19:9 ^ A 19 
u a 3.55 ■ 10 14 


AGLCl, 19) ^ S19 
h(n\^ cy ^ Afi . 1 

U W 3.55 ■ 10 14 


PSL(2,19) ^ A 2 n 
u w 3.55 ■ 10 14 


PGLC2.19) ^ S 2 

L/ l Li } O . 1U 

u w 3.55 ■ 10 14 


A(7) < A 21 

h(n\^ cy 7 70 . 1 

u a 1.01 • 10 16 


PGLC3, 4) ^ A 2 i 

f/ 1 Lt J l.OO i- IV 

U W 4.22 ■ 10 14 


PGL(2, 7) ^ S 2 i 

U\LL) <~-/ l.f O ■ ±IJ 

•u S3 1.52 ■ 10 17 


S(7) < Sn 
ou / ^ ^2 1 

6(u) 2 SB 7.79 ■ 10 22 
tt ra 1.01 • 10 16 


PGanunaLO, 4) S 2 l 
b(u) 2 a 1.35 • 10 20 
u a 4.22 ■ 10 14 


Mf991 < Ann 

b{u) 2 a 1.21 ■ 10 21 
u a 1.26 ■ 10 15 


Mf 991 ■ 9 < Son 

b(u) 2 a 1.21 ■ 10 21 
u a 1.26 ■ 10 15 


23:11 sS A 23 
b(u) 2 a 4.04 ■ 10 2S 
u a 5.10 ■ 10 19 


M(23) ^ A 2 3 
b(u) 2 a 1.21 ■ 10 21 
u a 1.26 ■ 10 15 


AGLCl, 23) ^ S 23 
b(u) 2 a 4.04 ■ 10 28 
u a 5.10 ■ 10 19 


M(24) ^ A 24 
b(u) 2 a 1.21 ■ 10 21 
u a 1.26 ■ 10 15 


PSLC2, 23) ^ A 2 4 
b(u) 2 a 4.04 • 10 28 
u a 5.10 ■ 10 19 


PGLC2, 23) < S 24 
b(u) 2 a 4.04 ■ 10 2S 
u a 5.10 • 10 19 


ASL(2, 5) :2 ^ A 25 
b(u) 2 a 2.58 • 10 31 
u a 1.29 ■ 10 21 


CAC5) x A(5)):2"2 ^ A 25 
b(u) 2 a 4.49 ■ 10 30 
u a 5.38 ■ 10 20 


AGLC2, 5) ^ S 25 
b(u) 2 a 2.58 ■ 10 31 
u a 1.29 ■ 10 21 


(S(5) X S(5)):2 S 25 
b(u) 2 a 4.49 • 10 30 
u a 5.38 ■ 10 20 


PSigmaL(2, 25) < A 26 
b(u) 2 a 2.58 • 10 33 
u a 1.29 ■ 10 22 


PGammaLC2, 25) ^ S 2 e 
b(u) 2 a 2.58 ■ 10 33 
u a 1.29 ■ 10 22 


ASLC3, 3) < A 2 7 
b(u) 2 a 1.99 ■ 10 34 
u a 3.59 ■ 10 22 


PSp(4, 3) :2 ^ A 27 
b(u) 2 a 1.01 ■ 10 33 
u a 1.05 ■ 10 23 


AGLC3, 3) ^ S 27 
b(u) 2 a 1.99 ■ 10 34 
u a 3.59 ■ 10 22 


PGaramaLC2, 8) ^ A 28 
b(u) 2 a 9.31 • 10 38 
u a 1.00 ■ 10 26 


PGammaUO, 3) ^ A 2S 
b(u) 2 a 1.45 ■ 10 37 
u a 1.26 • 10 25 


PSp(6, 2) A 28 
b(u) 2 a 1.01 ■ 10 33 
u a 1.05 ■ 10 23 


SC8) ^ A 28 
b(u) 2 a 1.30 • 10 36 
u a 3.78 ■ 10 24 


PSLC2, 27) :3 < A 28 
b(u) 2 a 4.13 ■ 10 38 
u a 5.17 ■ 10 24 
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PGammaLQ, 27) ^ S 2 s 29:14 ^ A 29 AGL(1, 29) ^ S 2 9 PSL(2,29) ^ A 30 

b(u) 2 S3 4.13 • 10 38 6(tt) 2 S3 1.08 ■ 10 43 b(u) 2 S3 1.08 ■ 10 43 6(u) 2 S3 1.08 • 10 4: 

«K5.17'10 24 u S3 1.08 ■ 10 28 u S3 1.08 ■ 10 28 u S3 1.08 • 1() 2S 



PGU2.29) ^ S 30 
6(u) 2 S3 1.08 • 10 4: 
u S3 1.08 • 10 28 



L(3, 5) ^ A 31 
6(u) 2 S3 2.28 • 10 4 
u S3 1.10 ■ 10 2S 



LC5, 2) $ A 31 
b(u) 2 S3 1.54 • 10 4 
u S3 4.11 ■ 10 26 



AGLC1 , 31) ^ S31 
6(u) 2 ~ 1-46 • 10 4 
u S3 8.84 ■ 10 30 



ASLC5, 2) A 32 PSL(2, 31) ^ A 32 PGLC2, 31) ^ S 32 PGammaL(2, 32) < A 33 

b(uf S3 1.54 ■ 10 40 b(uf S3 1.46 • 10 47 b(u) 2 S3 1.46 • 10 47 b(uf S3 1.31 • 10 4s 

u S3 4.11 ■ 10 26 u S3 8.84 ■ 10 30 u S3 8.84 • 10 30 u S3 2.65 • 10 31 



S(8) < A 35 PGanmaUO, 3) < A 36 PSp(4, 3):2 ^ A 36 PSpC6, 2) ^ A 36 

b(u) 2 S3 3.19 ■ 10 52 6(it) 2 S3 4.59 ■ 10 56 b(u) 2 si 5.11 ■ 10 53 6(it) 2 S3 3.19 • 10 52 

u S3 1.28 ■ 10 35 « S3 1.53 • 10 37 u S3 3.58 ■ 10 36 u S3 1.28 • 10 35 



A(9) A 36 
6(u) 2 S3 2.04 ■ 10 54 
u S3 1.02 ■ 10 36 



SC9) $ S 36 
b(u f S3 2.04 ■ 10 54 
u S3 1.02 ■ 10 36 



(S(6) 



x S(6)):2 ^ S 36 
b(u) 2 S3 5.11 • 10 51 
u S3 3.58 ■ 10 35 



(S(5) x S(5)):2 < S 36 
b(u) 2 S3 6.62 ■ 10 54 
u S3 1.29 ■ 10 37 



PSL(2,37) ^ A 38 
6(u) 2 S3 4.23 • 10 e 
u S3 1.03 ■ 10 40 



PGL(2,37) SC S 38 
6(u) 2 S3 4.23 ■ 10 f 
u S3 1.03 • 10 40 



PSp(4, 3) :2 ^ A 40 
b(u) 2 S3 2.94 • 10 5f 
u S3 7.86 ■ 10 42 



PSp(4, 3) sC A 40 
b(u) 2 Si 1.17 ■ 10 5 
u si 1.57 ■ 10 43 



PSLC4, 3) ^ A 40 PSp(4, 3):2 sC S40 

b(uf S3 3.63 ■ 10 56 b(uf S3 1.17 ■ 10 5S 

u si 6.72 ■ 10 40 u si 1.57 • 10 43 



PGL(4, 3) ^ S 40 PSLC2.41) < A 42 

b(u) 2 Si 3.63 • 10 56 b(u) 2 S3 1.97 ■ 10 E 

u si 6.72 • 10 40 u si 2.03 • 10 46 



PGL(2,41) ^ S 42 
b(u) 2 si 1.97 ■ 10 £ 
u si 2.03 ■ 10 46 



PSL(2,43) ^ A44 
6(u) 2 S3 5.31 ■ 10 71 
u si 3.34 ■ 10 49 



PGLC2.43) ^ S44 
b(u) 2 Si 5.31 ■ 10 7 
it S3 3.34 ■ 10 49 



S(10) A45 
6(u) 2 S3 6.98 • 10' 
u si 1.64 ■ 10 49 



PSp(4, 3):2 ^ S45 (A(7) x A(7)):4 ^ A 49 (S(7) x S(7)):2 ^ S49 PSU(3, B):2 $ A 50 

6(u) 2 S3 2.79 ■ 10 70 b(u) 2 Si 7.52 ■ 10 77 b(u) 2 S3 7.52 ■ 10 77 6(u) 2 S3 3.89 • 10 85 

u si 2.30 ■ 10 51 u si 1.19 ■ 10 55 u si 1.19 ■ 10 55 u S3 6.03 • 10 5s 



Alt(ll) sC A 5S SymUl) ^ S55 PSL(3, 7). 3 ^ A 57 PSL(6, 2) < A 63 

6(u) 2 S3 6.40 • 10 94 b(uf S3 6.40 ■ 10 94 b(u) 2 S3 4.02 • 10 104 b(u) 2 S3 2.32 ■ 10 109 

u si 3.18 ■ 10 65 u si 3.18 • 10 65 u si 3.59 • 10 69 u si 4.91 • 10 76 

AGLC6 , 2) ^ A 64 Sym(8) wreath Sym(2) ^ A 64 SymC12) $ A 66 Sym(13) ^ S 78 

6(u) 2 S3 2.32 ■ 10 109 b(u) 2 si 3.81 ■ 10 111 6(it) 2 S3 3.90 ■ 10 116 b(u) 2 S3 1.40 ■ 10 1 

u si 4.91 ■ 10 76 u si 1.95 ■ 10 79 u si 5.68 ■ 10 83 u si 1.81 • 10 105 



Alt(9)~2.2~2 ^ A sl SymC9) wreath Sym(2) ^ S 8 i Sym(lO) wreath Sym(2) ^ S100 

6(u) 2 S3 9.59 ■ 10 146 b(u) 2 S3 9.59 ■ 10 146 6(u) 2 S3 4. 



n 195 



: 2.20 • 10 



109 
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